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Abstract. The famous Lomonosov's invariant subspace theorem states that 
if a continuous linear operator T on an infinite- dimensional normed space 
E "commutes" with a compact operator K ^ 0, i.e., TK = KT, then T 
has a non-trivial closed invariant subspace. We generalize this theorem for 
multivalued linear operators. We also provide some applications to single- 
valued linear operators. 



1. Introduction. 

The Invariant Subspace Problem asks whether every linear operator h : Y —> 
Y on an infinite dimensional topological vector space Y has a nontrivial closed 
invariant subspace, i.e., a linear subspace M of Y such that M ^ {0}, M ^ Y 
and h{M) C M (for a survey and references see [l]). In general the answer is 
negative and the issue is to investigate the class of operators satisfying this property. 
It is known that every compact operator k belongs to this class and so does every 
operator h commuting with k : 

hk = kh. 

The famous Lomonosov's invariant subspace theorem HI states the following. 

Theorem 1.1. Suppose Y is an infinite dimensional normed space, h and k 
are continuous linear operators, k is compact, nonzero and commutes with h. Then 
h has a nontrivial closed invariant subspace. 

In this paper we generalize this result for multivalued linear operators. The 
theory of multivalued linear maps (linear relations) is well developed, see Cross 
A multivalued map h : X — » Y between vector spaces is called a linear relation if 

h{ax) = ah{x), h(x + y) — h(x) + h(y), 

for all x, y G X and all a ^ 0. We say that h, k : Y — ► Y commute if 

hk C kh. 
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For a linear relation h : Y — » Y, a subspace M of Y is called h-weakly-invariant if 
for all x G M 

h(x) n M 7^ 0. 



The idea of the proof of our main theorem below (Corollary 6.5) can be traced back 
to the original Lomonosov's proof. 

Theorem 1.2. Suppose Y is an infinite dimensional normed topological vector 
space, h and k are continuous linear relations with nonempty finite dimensional 
values, k is compact and commutes with h, fc _1 (0) ^ Y. Then there is a nontrivial 
closed h-weakly-invariant subspace. 

Invariant subspace theorems for linear relations provide tools for studying the 
Invariant Subspace Problem for single valued linear operators. We consider those 
in the last section. 

All topological spaces are assumed to be Hausdorff, all maps are multival- 
ued with nonempty values unless indicated otherwise, by normed (locally convex) 
spaces we understand infinite dimensional normed (locally convex) topological vec- 
tor spaces over C or R. 

2. Preliminaries. 

Let X be a topological space. The a partition of unity is a collection of contin- 
uous functions 7 = {d a : a G A} satisfying 

2_jd a (x) = l,x G X. 

The partition 7 is called locally finite if the cover 7' = {d~ 1 ((0, 1]) : a G A} of X 
is locally finite, and 7 is called subordinate to an open cover lo of X if 7' refines u>. 

Let F : X — > Y be a multifunction (a set- valued map F : X — » 2 Y ), where 
X,Y are topological spaces. We call F lower-semicontinuous (l.s.c.) if F^ 1 (B) = 
{x G X : F[x) l~l B 7^ 0} is open for any open B. We call F upper- semicontinuous 
(u.s.c.) if F^ 1 (B) is closed for any closed B. Equivalently, for any x G X and an 
neighborhood V of F(x), there is a neighborhood U of x such that 

y G U F(y) c V. 

If F is both u.s.c. and l.s.c. we call it continuous (in Q "continuous" means l.s.c). 
When X and Y are uniform spaces §, Chapter 8] we say that F is uniformly upper- 
semicontinuous (u. u.s.c.) if for any entourage V in Y there is an entourage U in 
X, such that for all x, y G X, 

xey + U F(x) C F(y) + V. 

We say that x £ X is a fixed point of F : X — > X if x G F(a;). We say that a 
single- valued function g : X — > Y is a selection of F : X — > Y if <?(x) G F(z) for all 

A topological space is called acyclic if its reduced Cech homology groups over 
the rationals are trivial. The set of all acyclic spaces includes convex subsets of 
locally convex spaces. A multivalued map F : X — > Y is called admissible (in the 
sense of Gorniewicz pi) if it is closed valued u.s.c. and there exist a topological 
space Z and two single-valued continuous maps p : Z —> X, q : Z — > Y such that 
for any x G X, (i) p^ 1 {x) is acyclic, and (ii) q(p~ 1 (x)) C F(x). 
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Proposition 2.1. Theorem IV.40.5, p. 200] The composition of two ad- 
missible maps is admissible. 

In the proof of his theorem Lomonosov used the Schauder fixed point theorem. 
Here we need its analogue for multivalued maps. We use a result that follows 
from the Lefschetz fixed point theory for admissible maps given in [Q (for further 
developments see J?) ) , although an appropriate version of the Kakutani fixed point 
theorem for compositions of convex valued maps would suffice. 

Theorem 2.2. [§, Theorem IV.41.12, p. 207] If X is an acycic ANR, then X 
has the fixed point property within the class of compact (i.e., with f{X) compact) 
admissible maps. 

3. Approximation by Convex Combinations. 

In this section we consider the approximations of multivalued maps by convex 
combinations in the spirit of Simonic ^ ^] . 

Let X be a topological space, Y be a vector space and H a collection of multi- 
valued maps h : X — > Y. Given a partition of unity 7 = {d a : a S ^4} in X, for any 
collection {ft„ : a G i} C ff, we can define a new map h : X — ■> Y by 

(3.1) h(x) = d a (x)h a (x). 

The set of all such h we denote by C onv 1 (H) . 

Let A n denote the standard n-simplex. For any collection ho,...,h n and any 
(to, t n ) £ A n , we define a new map h : X — > Y by 

n 

h(x) = y]tjhi(x). 

i=0 

The set of all such h we denote by Conv(H). 
Remark 3.1. He Conv(H) c Conv 7 (H). 
The following theorem generalizes Lemma 3.1 of Simonic 

Theorem 3.2 (Approximation). Let X be a paracompact uniform space andY 
be a locally convex space. Suppose s : X — » Y is u.u.s.c. map with convex values 
and H is a collection of u.s.c. maps h : X — > Y". Suppose V is a convex neighborhood 
of in Y and for any x € X there is h x S H such that 

h x (x) C s(x) + V. 

Then there exist a locally finite partition of unity 7 on X and a map f 6 Conv-y(H) 
with values such that for all x £ X, 

f(x) c s(x) + W. 

Proof. From the upper semicontinuity it follows that for each i£l there is 
a W x such that for any y e W x , 

K{y) C h x {x) + V, and s(x) C s(y) + V. 

Now applying these inclusions and the assumption of the theorem, we obtain the 
following: for any y S W x , 

h x (y) Ch x (x) + Vc s(x) + 2V C s(y) + 3V. 
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Consider the open cover of X given by u> = {W x : x £ X}. From Michael's 
Lemma |3|, Theorem 5.1.9, p. 301] it follows that there exists a locally finite par- 
tition of unity 7 = {d a : a £ A} subordinate to u>. Then we have a locally hnite 
open cover of X 

to' = {U a =d- 1 ((0,l]):aeA} 

that refines u>, i.e., for each a £ A there is x(a) S X such that J7 a C W x i a y 
Fix y £ X. Suppose a £ A and (i a (y) > 0. Then y £ U a C W x ( a y Hence 

(y) C + 3V. 

As s(y) and V are convex, so is the set s(y) + 3V. Therefore a convex combination 
01 h>x(a)(y)> a G ^4 is a well defined subset of s(y) + 3V. Then the map / : X — > Y 
given by 

is well defined and belongs to Conv 1 {H). □ 

Simonic calls the functions d a Lomonosov functions as the idea of this con- 
struction goes back to Lomonosov's proof in Q. Observe also that this theorem 
implies the following well-known fact: any u.s.c. map with convex images from a 
compact metric space to a locally convex space can be approximated by continuous 
single-valued maps. 

4. Fixed Points of Convex Combinations. 

In this section we obtain a preliminary fixed point result. 

Proposition 4.1. Let X be a topological space, Y a vector space, H be a col- 
lection of maps h : X — > Y, r : Y —> X a map, 7 a locally finite partition of unity 
on X, f £ Conv~ ( (H), and suppose fr:Y^Y has a fixed point yo. Then there 
exists g £ C'onv(H) such that yo is a fixed point of gr. 

PROOF. Wc know that y £ fr(y ). Let Z = Graph(r) C Y x X, p : Z ^ y,q : 
Z — ► X be the projections. Then there is zq £ Z such that yo — p(zq) £ fq(zo). 
Assume that 7 = {d a : a £ A} and suppose 

f( x ) = y^;d a (x)h a (x), 

where h a £ H. Let xq = q(zo). Suppose {a £ A: d a (xo) > 0} = {ao, ...,a n },n > 0. 
For i = 0, n, let 

U = d ai (x ),hi = h ai . 
Then yo £ fq(zo) = f(xo) = $^.-_ Uhi(xo)- We have an element of Conv(H) : 

a 

g{x) = y^jjhj(x),x £ X. 

Consider 

gq( z o) =Y%=oUhi{q{za)) 

= E"=o d ai (x )hi(q(zo)) 
= J2 a eA d ai (q(zo))hi{q{z Q j) 
= fq(zo) 

9 p(zo) = yo- 
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Thus yo is a fixed point of gr. □ 

If Y is a topological vector space, we denote by F C (X,Y) the set of all u.s.c. 
maps F : X — > Y with compact convex values. Then all elements of F C (X, Y) are 
admissible provided Y is locally convex. 

Lemma 4.2. Conv y (F c (X,Y)) C F C (X,Y). 

Theorem 4.3 (Fixed Points). Let Y be a locally convex space, A C Y closed 
convex, U a closed neighborhood of A, X a paracompact uniform space. Let r E 
F C (U,X), r(U) compact, H C F C (X,Y), and 



H{x) n A ^ 0, for all x E X. 
Then for any neighborhood W of A, Conv(H)r has a fixed point in W. 

PROOF. Assume that there is a convex neighborhood V of such that U — 
A + W C W and for each x E X, there is h x E H such that h x (x)C\(A + l/2V) ^ 0. 
Now, for each h E H, let 



h'(x) = h(x) n (A + 1/2V) 

and let H' = {hi : h E H}. Then the set h'{x) is nonempty by assumption, convex 
since Y is locally convex, compact as the intersection of a compact set and a closed 
set. Also h! is u.s.c. by [§, 1.7.17(c)]. Thus ti E F C (X,Y). Now we apply Theorem 



3.2 with s(x) — A for all x (by definition h' x (x) C s(x) + V). Therefore there exists 



/ E Conv 7 (H') such that for all x, fix) C s[x) + 3V = U. We know that r, / are 



admissible. Therefore by Proposition 2.1 , so is ip = fr : U —*U. Now r is compact 



and U is an ANR as a closed neighborhood in a locally convex space. Hence by 



Theorem 2.2, 99 has a fixed point yo & U C W. Therefore by Proposition 4.1, there 
exists g E Conv(H) such that yo is a fixed point of gr. □ 

5. Properties of Linear Relations. 

Throughout the rest of the paper we assume that X and Y are normed spaces. 

Definition 5.1. [§, 11.1. 3, p. 25] A multivalued map h : X — > Y is called a 
linear relation if it preserves nonzero linear combinations, i.e., for all x,y E X, all 
a,b E R\{0}, we have 

h(ax + by) — ah(x) + bh(y). 

Then h(Q) is a linear subspace. The set of all linear relations will be denoted by 
LR(X,Y), and LR(X,X) = LR(X). 

Lemma 5.2. §, Proposition 1.2.8, p. 7] If T E LR(X,Y), x E X, then 

T(x) = y + T(0), for any y E T(x). 
We will concentrate on the following classes of linear relations: 

LR (X,Y) = {h E LR(X,Y) : h is continuous, dim/i(0) < 00}, 
LR (Y) =LR {Y,Y). 

Of course, all bounded linear operators belong to LRq(X, Y). 

For a linear relation T E LRq (X, Y) , let Qt denote the natural quotient map 
with domain X and null space T(0) pi p. 25]. 
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Lemma 5.3. If S e LR (X,Y), T e LR (Y,Z), then TS G LR (X,Z). 

PROOF. Q t T : 5(0) -> Z/T(0) is a linear operator, so dim Q T T£(0) < oo. 
Now dimT(O) < oo implies dimTS(O) < oo. □ 



Definition 5.4. M A linear relation T G LR (X,Y) is called bounded (com- 
pact) if the single valued operator QtT is bounded (compact), i.e., it maps a 
bounded set into a bounded (compact) set. 

By Proposition 11.3.2(a) in ^ p. 33], every element of LRq(X, Y) is bounded. 

Lemma 5.5. Suppose Y is normed. Then T G LRq(X, Y) is compact if and 
only if for any bounded B C X, there is a compact set C C Y such that T(B) C 
C + T(0). Moreover C can be chosen such that T(x) (~l C ^ for all x G B. 

Proof. The "if" part is obvious. Next, if Q T T : X -> Z = Y/T(0) is a 
compact linear operator, then for any bounded B C X, there is a compact D C Z 
such that QtT(B) C D. Now since T(0) is a finite dimensional subspace of a normed 
space, it is topologically complemented, i.e., Y is homeomorphic to Z©T(0). Then 
C = D © {0} is compact in Y and T{B) C C + T(0). □ 



Theorem 5.6. Suppose h € LRo(X,Y) and k G LR,q(Y, Z) is compact. Then 
hk G LRo(X, Z) is compact. 

PROOF. Let A be a bounded subset of X. Then by Lemma |5~5|, k(A) C C+fc(0), 
where C is compact. Therefore hk(A) C /i(C) + hk(0). It is easy to show that there 
is a bounded set D in Z such that /i(C) = D + h(0). Let h'(x) = h(x) ("1 U. Then 
h'(x) is compact as h(x) is finite dimensional. In particular, h'(x) is closed, so by 
P| 1.7.17(c)], h' = h(lD is u.s.c. Therefore /i(C) nfl = /i'(C) is compact in Z by 
B, Proposition II. 14.9, p. 69]. But D C h'(C), hence D is precompact. Thus 

frfc(A) G h(C) + hk(0) = D + h(0) + hk(0) = D + fcfc(O), 

where D is precompact, so /ifc is compact by Lemma 5.5. □ 



Therefore compact relations constitute a left ideal in LR (Y). 

We call G C LR(Y) a semialgebra if it is closed under nonzero linear combina- 
tions and compositions. The above lemma implies that LRq(Y) is a semialgebra. 
We define the commutant of h as 

Comm(h) = {/ G LRq(Y) : f commutes with h}. 

Lemma 5.7. If h G LR(Y) then Comm(h) is a semialgebra. 

Proof. First, Comm(h) is closed under linear combinations. Indeed, for 
/, /' G Comm(h), a, b G R\{0}, we have 

h(af + bf) = ahf + bhf G afh + bf'h = (af + bf')h. 

Second, if /, g both commute with h, then u = gf commutes with h. Indeed 

hu = hgf C ghf C gfh = uh. 

□ 
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6. Invariant Subspaces of Linear Relations. 

Lemma 6.1. Suppose G C LR(Y) is a semialgebra. Then for any u G Y, 
G(u) U {0} is a linear subspace ofY. 

PROOF. Let x, y G G(u), then x G f{u),y G for some /, /' £ G. Suppose 

a, be R\{0} and let g = af + bf'e G. Then 

ax + &y G af(u) + bf(u) = g(u) C G(u). 

□ 

Lemma 6.2. Suppose R G LR(Y). Then 

Fix(R) = {x G y : x G i?(x)} 

is a linear subspace of Y. 

Proof. Let a, 6 G R\{0},x,y G Fix(R). Then ax + by £ aR(x) + bR(y) = 
R(ax + by), so ax + by G Fix(R). □ 

Lemma 6.3. Suppose h G LR(Y),R G Comm(h) and h(Q) C i?(0). TTien M = 
Fix(R) is h-weakly-invariant. 

Proof. Let x e M = Fix(R). Then A = fr(x) G fc-Rfx) C i?/i(x) = In 
particular, there is some z e A such that Ha ^ 0. Suppose y G -R(z) flA Now 



we use Lemma 5.2, as follows: 

zei = fr(x) = y + 7i(0) C y + #(0) = R(z). 
Hence z G Fix(R) = M, so ft(x) n M □ 
The main results of this paper are given below. 

Theorem 6.4 (Weakly Invariant Subspaces). Suppose Y is a normed space, 
h G LR(Y), G C Comm(h) is a semialgebra, k G Comm(h) is compact and 
fc _1 (0) 7^ y Suppose that for all g 6 G, /i(0) C gk(0). Then there exists a nontrivial 
closed linear subspace M C Y such that 

either (1) M is G-invariant, 

or (2) M is finite- dimensional and h-weakly-invariant. 

Proof. For each u G Y, G(u) is G-invariant. Indeed, suppose x G G(it) and 
g EG. Then x G f(u) for some / G G. Therefore gf G G and y(x) C 5/(m) C G(u). 
Suppose now that Q = G(uq) is not dense in Y for some uq G y\{0}. Then 
we can assume that Q ^ {0}, because otherwise span{uo} is G-invariant. Then 
M = Q = Q U {0} is the desired subspace. First, L = QU{0} is a linear subspace of 
Y by Lemma |6~T| . Second, since every / G G is u.s.c, /(Q) C Q implies /(Q) C Q. 
Hence M is G-invariant. 

Assume now that G(y) is dense in Y for each y G y\{0}. Since fc is u.s.c, 
fc _1 (0) is closed. Therefore we can choose a closed convex neighborhood £/ C Y of 
some 6 G Y\{0} such that ^ U and f7 C y\fc _1 (0). In addition we have 



(*) b(EG{y), for all y G Y"\{0}. 



Now we apply Theorem 4.3 with X = Y\{0}, A = {b} as follows. We let H 



{g n U : g G G}. Then iJ C F c (y). We can also rewrite (M) as 



H(x) flA^j), for all x G y\{0}. 
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By Lemma 5.5, there is a compact C CY such that k(x) n C ^ 0. Let r = k D C £ 
P C (Y,Y). Since A: is compact, r(Z7) is precompact. Therefore by Theorem 4.3, for 



any neighborhood W of b, Conv(H)r has a fixed point in W. Therefore there is 
g G Conv(G) C G such that R = gk has a fixed point y ^ 0. Thus 



M = Fix(R) ^ {0}. 



), and 



Now R G Comm(h) (Lemma 5.7), Af is a linear subspace of Y (Lemma |6. 
M is /i-invariant (Lemma 6.3). 

Suppose now that flcMisa bounded neighborhood of 0. Since R is compact 
by Theorem |5.6| , we have B C R(B) C C + R(0), where G is compact and P(0) is 
finite dimensional. Therefore M is finite dimensional. □ 



COROLLARY 6.5. Suppose Y is a normed space, h G LRq(Y), k G Comm(h) is 
compact and fc _1 (0) ^ Y. Then there exists a nontrivial closed h-weakly-invariant 
subspace M C Y . 

Proof. Let 

G = {P{h) : P is a polynomial without constant term}. 

Then G C Comm(h) and G is a semialgebra. To check the rest of the conditions 
of the theorem, observe that since G A;(0), we have h n (0) C h n k(0) for all n > 0. 
Therefore h(0) C h n (0) C /i"fc(0) for all n > 1, so that h(0) C P(/i)(0) for any 
polynomial P without constant term. Thus for all g G G, /i(0) C gk(0). Therefore 
by the theorem there is a nontrivial closed linear subspace M C Y which is either 
G- invariant or ft,- weakly- invariant. Since h G G, M is h- weakly- invariant. □ 



Remark 6.6. When both h and k are single valued, the corollary reduces to 



Lomonosov's Theorem 1.1. The corollary is vacuous when h is single- valued while 



k is not, because hk C kh implies that k(0) is a finite-dimensional /i-invariant 



subspace. Yet in the next section we will obtain some applications of Theorem 3.4 
to linear operators. 



7. Applications to Invariant Subspaces of Linear Operators. 

In this section we generalize a well known corollary to Lomonosov's Theorem 

Lemma 7.1. Suppose h,k G LR(Y). Then 

G = {ge Comm{h) : h{0) C gk{0)} 

is a semialgebra. 



Proof. By Lemma 5.7 Comm(h) is a semialgebra, so we need only to consider 
the following. (1) Suppose h(0) C fk{0) and h(0) C gk(0), a, b G C\{0}. Then 
h(0) C a/fc(0) + bgk(0) — (af + bg)k(0) because /i(0) is a linear subspace. Thus G 
is closed under nonzero linear combinations. (2) Suppose /i(0) C /fc(0), g commutes 
with h. Now since G g(0), we have 

MO) C hg(0) C fl fc(0) C ff /*(0). 

Hence G is closed under compositions. □ 
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Suppose Y is a space over C. Given h G LR(Y), its eigenvalue A G C and 
eigenvector w^O satisfy 

Xu G h(u) 

(or ker(A/c? — h) ^ {0}). The eigenspace of h corresponding to A is given by 

E h \ = {u G Y : Xu G h(u)}. 

Lemma 7.2. If h G LR(Y) is u.s.c. then E^x is a closed linear subspace. 
Proof. The set Eh\ = (Xld — /i) _1 (0) is closed because h is u.s.c. □ 

The next lemma is obvious, see §, Chapter 6]. 

Lemma 7.3. Let E be a finite dimensional space over C. Then any h G LRq(E) 
has an eigenvector. 

We say that the maps h,k : Y — > Y strictly commute if 

kh = hk. 

Theorem 7.4 (Invariant Subspaces). Let Y be a normed space over C, h G 
LR{Y) is u.s.c, for any X G C, Xld is not a selection of h, k G Comm(h) compact, 
k~ (0) ^ Y. If a linear operator f : Y — > Y strictly commutes with h and h(0) C 
fk(0), then there is a nontrivial closed f -invariant subspace. 



PROOF. By Lemma 7.1 



G = {g G Comm{h) : h(0) C .gfc(0)} 



is a semialgebra. Therefore by Theorem p.4| there is a nontrivial closed subspace M 
that is either (1) G-invariant or (2) finite-dimensional and ft,-weakly-invariant. In 
case of (1) M is /-invariant because / G G. Consider (2). If h! = h n M : M -» M 



then ft,' is a linear relation with nonempty values. Then by Lemma 7^ , h' has an 
eigenvector corresponding to some A G C. Therefore the eigenspace N = Eh\ is 
nonzero, closed and not equal to the whole Y. Then for each x G N, we have 

A/(x) = /(Ax) G /%) = 

Hence f(x) eJV. □ 

The following result involves only single valued operators. 

Corollary 7.5. Let Y be a normed space over C, TV be a finite dimensional 
subspace of Y, f,h,k:Y^Y bounded linear operators. Suppose for any A G C, 
h =/= Xld, k is nonzero compact. Suppose also that 

(1) fh = hf, 

(2) hk-khe N, 

(3) h{N) c N. 

Then there is a nontrivial closed f -invariant subspace. 

Proof. Apply the above theorem to the linear relation k + N. □ 
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